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Abstract 

We derive predictions for the Nadir angle (6 n ) dependence of the ratio N^/Ne of the 
rates of the fj,— like and e— like multi-GeV events measured in water-Cerenkov detectors 
in the case of 3-neutrino oscillations of the atmospheric v e (v e ) and i/„ (fin), driven by 
one neutrino mass squared difference, lAm 2 ^ ~ (2.5 — 3.0) x 10 -3 eV 2 3> Am^. This 
ratio is particularly sensitive to the Earth matter effects in the atmospheric neutrino 
oscillations, and thus to the values of sin 2 #13 and sin 2 623, 613 and 623 being the neutrino 
mixing angle limited by the CHOOZ and Palo Verde experiments and that responsible 
for the dominant atmospheric —* v T {p^ — > v T ) oscillations. It is also sensitive to 
the type of neutrino mass spectrum which can be with normal (Am^ > 0) or with 
inverted (Arn^j < 0) hierarchy. We show that for sin 2 #13 ^ 0.01, sin 2 6*23 ^ 0.5 and 
at cos 9 n ^ 0.4, the Earth matter effects modify substantially the 9 n — dependence of 
the ratio A^/iV e and in a way which cannot be reproduced with sin 2 #13 = and a 
different value of sin 2 623- For normal hierarchy the effects can be as large as ~ 25% for 
cos 6<n ~ (0.5 — 0.8), can reach ^ 35% in the Earth core bin cosO^ ~ (0.84 - 1.0), and 
might be observable. They are typically by ~ 10% smaller in the inverted hierarchy 
case. An observation of the Earth matter effects in the Nadir angle distribution of the 
ratio N^/N e would clearly indicate that sin 2 #13 ^ 0.01 and sin 2 623 ^ 0.50. 



*Also at: Institute of Nuclear Research and Nuclear Energy, Bulgarian Academy of Sciences, 1784 Sofia, 
Bulgaria. 



1 Introduction 



The publication of the first results of the KamLAND experiment marks the beginning 
of a new era in the studies of neutrino mixing and oscillations - the era of high precision 
determination of the neutrino mixing parameters. The data obtained by the solar neutrino 
experiments Homestake, Kamiokande, SAGE, GALLEX/GNO and Super-Kamiokande (SK) 
provided the first strong evidences for oscillations of flavour (electron) neutrinos. Strong 
evidences for oscillations of the atmospheric (z^) neutrinos were obtained by the Super- 
Kamiokande (SK) experiment The evidences for solar v e oscillations into active neutrinos 
u^t, were significantly reinforced during the last two years i) by the combined first data of the 
SNO experiment ff., and the SK data [2], ii) by the more recent SNO neutral current data [3], 
and iii) by the first results of the KamLAND jH] experiment. The KamLAND data practically 
establishes under the plausible assumption of CPT-invariance, the large mixing angle 
(LMA) MSW solution as unique solution of the solar neutrino problem. This result brings 
us, after more than 30 years of research, initiated by the pioneer works of B. Pontecorvo [7j 
and the experiment of R. Davis et al. [H], very close to a complete understanding of the true 
cause of the solar neutrino problem. 

The interpretation of the solar and atmospheric neutrino, and of the KamLAND data in 
terms of neutrino oscillations requires the existence of 3-neutrino mixing in the weak charged 
lepton current (see, e.g., 0): 
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Here vil, I = e,fi,r, are the three left-handed flavor neutrino fields, is the left-handed 
field of the neutrino Uj having a mass rrij and U is the Pontecorvo-Maki-Nakagawa-Sakata 
(PMNS) neutrino mixing matrix [TU] . 

C12C13 S12C13 
U = U ul U u2 | = | -S12C23 - ci2S23Si 3 e l(5 C12C23 - s 12 s 2 3Sne lS 

■512-523 ~ Ci2C23' S i3e* <5 — C12S23 — Si2C23Si3e lS 

where we have used a standard parametrization of U with the usual notations, 
Cij = cos dij, and 5 is the Dirac CP- violation phase 1 . If we identify i 
with the neutrino mass squared differences which drive the solar and atmospheric neutrino 
oscillations, Am^ = Am^ > 0, Am\ = Am| 1; the data suggest that (Am^j 3> Am^. 
In this case 9u and #23, represent the neutrino mixing angles responsible for the solar and 
atmospheric neutrino oscillations, 6*12 = 6> , #23 = 9 a, while 9i 3 is the angle limited by the 
data from the CHOOZ and Palo Verde experiments [T3*l ITij. 

Combined u e — > v^m and v e — > v^W) oscillation analyses of the solar neutrino and 
KamLAND |Hj data, performed under the assumption of CPT-invariance which we will 
suppose to hold throughout this study, show [13 EE] that the data favor the LMA MSW 
solution with Am| = (6.9 - 7.3) x 10" 5 eV 2 and tan 2 6 Q = (0.42 - 0.46). A second, 
statistically somewhat less favored LMA solution (LMA II) exists at [TBI ITE] Am@ = 1.5 x 

1 We have not written explicitly the two possible Majorana CP-violation phases which do not enter into 
the expressions for the oscillation probabilities of interest (see also 52)- We assume throughout this 

Study < 012,023,013 < tt/2. 
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10~ 4 eV 2 . The atmospheric neutrino data, as is well known, is best described [3J in terms of 
dominant — > v T (P M — > u T ) oscillations with |Am}| = 2.5 x 10~ 3 eV 2 and sin 2 29 a — 1-0. 
The 90% CL. allowed intervals of values of the two-neutrino oscillation parameters found 
in [Sj read |Am}| = (1.9 - 4.0) x 10" 3 eV 2 and sin 2 29 A = (0.89 - 1.0). According to the 
more recent combined analysis of the data from the SK and K2K experiments [I""", one 
has |Am}| = (2.7 ± 0.4) x 10~ 3 eV 2 . We will often use in our analysis as illustrative the 
values |Am}| = 3.0 x 10~ 3 eV 2 and sin 2 29a = 0.92; 1.0. Let us note that the atmospheric 
neutrino and K2K data do not allow one to determine the signs of Am}, and of cos 29 a when 
sin 2 29a 7^ 1-0. This implies that in the case of 3-neutrino mixing one can have Am 2 x > 
or Am 2 ! < 0. The two possibilities correspond to two different types of neutrino mass 
spectrum: with normal hierarchy (NH), mi < ni2 < m^, and with inverted hierarchy (IH), 
m 3 < mi < m 2- The fact that the sign of cos2#a is not determined when sin 2 2#A 7^ 1-0 
implies that when, e.g., sin 2 26* a = sin 2 26> 2 3 = 0.92, two values of sin 2 6*23 are possible, 
sin 2 #23 = 0.64 or 0.36. 

In what regards the mixing angle 9 13 , a 3-v oscillation analysis of the CHOOZ data [IH| 
led to the conclusion that for Am^ ^ 10~ 4 eV 2 , the limits on sin 2 #13 practically coincide 
with those derived in the 2-v oscillation analysis in jT3] . A combined 3-z/ oscillation analysis 
of the solar neutrino, CHOOZ and the KamLAND data, performed under the assumption 
of Am% < l Am il (see, e.g., 0113), showed [TS] that sin 2 13 < 0.05 at 99.73% CL. The 
authors of [I"5] found the best-fit value of sin 2 #13 to lie in the interval sin 2 9 13 = (0.00 — 0.01). 

Getting more precise information about the value of the mixing angle #13, determining the 
sign of Am}, or the type of the neutrino mass spectrum (with normal or inverted hierarchy), 
and measuring the value of sin 2 #23 with a higher precision is of fundamental importance for 
the progress in the studies of neutrino mixing. 

The mixing angle #13, or the absolute value of the element U e 3 of the PMNS matrix, 
\U e s\ = sin 0i3, plays a very important role in the phenomenology of the 3-neutrino oscilla- 
tions. It drives the sub-dominant z/ M <-> u e (z/ M <-> v e ) oscillations of the atmospheric {p^) 
and v e (u e ) [201 [2H 122]- The value of 6*13 controls also the — > u e , — > P e , v e — > and 

~~ ► transitions in the long baseline neutrino oscillation experiments (MINOS, CNGS), 
and in the widely discussed very long baseline neutrino oscillation experiments at neutrino 
factories (see, e.g., [SHI I2H 1251 EE])- The magnitude of the T- violating and CP- violating 
probabilities in neutrino oscillations is directly proportional to sin #13 (see, e.g., j23EHl[29 J). 
Thus, in the sub-dominant channels of interest to T- and CP-violation studies, the corre- 
sponding asymmetries become proportional to Am 2 & / sin#i 3 [23 ED]- The value of sin 9 13 is 
thus of prime importance. 

If the neutrinos with definite mass are Majorana particles (see, e.g., [121)) the predicted 
value of the effective Majorana mass parameter in neutrinoless double j3— decay depends 
strongly in the case of hierarchical neutrino mass spectrum on the value of sin 2 #13 (see, e.g., 

EU). 

The sign of Am} determines, for instance, which of the transitions (e.g., of atmospheric 
neutrinos) — > v e and v e — > or — > v e and v e — > can be enhanced by the Earth 
matter effects [*"""". 13*3*1 EH]- The predictions for the neutrino effective Majorana mass in 
neutrinoless double (3— decay depend critically on the type of the neutrino mass spectrum 
(normal or inverted hierarchical) [HlJ IHHj • The knowledge of the value of #13 and of the sign 
of Am} = Am 2 x is crucial for the searches for the correct theory of neutrino masses and 



3 



mixing as well. 

Somewhat better limits on sin 2 9\3 than the existing one can be obtained in the MINOS 
experiment [36 . Various options are being currently discussed (experiments with off-axis 
neutrino beams, more precise reactor antineutrino and long base-line experiments, etc., see, 
e.g., [37]) of how to improve by at least an order of magnitude, i.e., to values of ~ 0.005 
or smaller, the sensitivity to sin 2 #13. The sign of Am\ can be determined in very long 
base-line neutrino oscillation experiments at neutrino factories (see, e.g., [2H1E]), and, e.g, 
using combined data from long base-line oscillation experiments at the JHF facility and with 
off-axis neutrino beams [3H]- If the neutrinos with definite mass are Majorana particles, it 
can be determined by measuring the effective neutrino Majorana mass in neutrinoless double 
(3— decay experiments jHUIHSI- Under certain rather special conditions it might be determined 
also in experiments with reactor v e [39. 

In the present article we study possibilities to obtain information on the value of sin 2 # 13 
and on the sign of Am\ = Amf j using the atmospheric neutrino data, accumulated by the SK 
experiment, and more generally, that can be provided by future water-Cerenkov detectors, 
like UNO and Hyper-Kamiokande. We consider 3-neutrino oscillations of the atmospheric 
Up, Up, v e and v e under the condition Am^ = Am^ <C I Ami I = l^ m 3il> which is suggested 
to hold by the current solar and atmospheric neutrino data. Under the indicated condition, 
the expressions for the probabilities of — > u e (v e — > Vy) and z/ M — > u e {p e — > Vy) transitions 
contain sin 2 #23 as a factor, which determines their maximal values. Depending on the sign 
of Am 2 1; the Earth matter effects can resonantly enhance either the —>■ u e and v e — > u^, or 
the — > u e and Vy — ► i>y transitions if sin 2 9 13 7^ 0. The effects of the enhancement can be 
substantial for sin 2 #13 ?Z 0.01. They are larger in the multi-GeV e-like and [i— like samples of 
events and for atmospheric neutrinos with relatively large path length in the Earth, crossing 
deeply the mantle [23121] or the mantle and the core [201 E2 H3 El 112] , i.e., for cos# n > 0.4, 
where 9 n is the Nadir angle characterizing the neutrino trajectory in the Earth. 

The — ► v e {py — > Ve) and v e —>■ [p e — > v^) transitions in the Earth lead to the 
reduction of the rate of the multi-GeV fi— like events and to the increase of the rate of the 
multi-Gev e— like events in the Super-Kamiokande (or any other water-Cerenkov) detector 
with respect to the case of absence of these transitions (see, e.g., [201 |2H 1221 HH H2] )■ 
Correspondingly, as observables which are sensitive to the Earth matter effects, and thus to 
the value of sin 2 613 and the sign of Arn^j , as well as to sin 2 623 , we consider the Nadir-angle 
distributions of the ratios Nf/Nl v and N*"/N%, where N^ u and iV e 3l/ and are the multi-GeV 
/i— like and e-like numbers of events (or event rates) in the case of 3-v oscillations of the 
atmospheric v e , v e and u^, and N® is the number of e— like events in the case of absence 
of oscillations (sin 2 613 = 0). The ratio of the energy and Nadir angle integrated /x— like 
and e— like events, N^/N e , has been measured with a relatively high precision by the SK 
experiment The systematic uncertainty, in particular, in the Nadir angle dependence 
of the ratio N^/N^, can be smaller than those on the measured Nadir angle distributions of 
/i— like and e— like events, iV M and iV e . 

We obtain predictions for the Nadir-angle distributions of N^ u /N^ u and of N^ v /N® both 
for neutrino mass spectra with normal (Am^ > 0) and inverted (Am^ < 0) hierarchy, 
WWW (tffW)m, (iV e 3 7^ e )NH and (N^/N° e ) m , and for sin 2 6 23 = 0.64; 0.50; 0.36. 
We compare the latter with the predicted Nadir-angle distributions i) of the ratio N^/N e 
for the case the 3-neutrino oscillations taking place in vacuum, (N^ u /N^ u ) vac , and ii) of the 
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ratio /N®, where N?f is the predicted number of /i— like events in the case of 2-neutrino 
— > z/ T and — > v T oscillations of the atmospheric and v^. Predictions for the different 
types of ratios indicated above of the suitably integrated Nadir angle distributions of the 
jj,— like and e— like multi-GeV events are also given. Our results show, in particular, that 
for sin 2 #23 ~ 0.50 sin 2 #13 ^ 0.01 and Am 2 ^ > 0, the effects of the Earth matter enhanced 
— > v e and v e —>■ transitions of the atmospheric and u e , might be observable with the 
Super-Kamiokande detector. Conversely, if the indicated effects are indeed observed in the 
Super-Kamiokande experiment, that would suggest in turn that sin 2 # 13 ^ 0.01, sin 2 #23 ^ 
0.50 and that the neutrino mass spectrum is with normal hierarchy, Am 2 x > 0. 

Let us note finally that the Earth matter effects have been widely investigated (for a 
recent detailed study see, e.g., ref. [43 J which contains also a rather complete list of references 
to earlier work on the subject). However, the study of the magnitude of the Earth matter 
effects in the Nadir angle distribution of the ratio of the multi-GeV /i— like and e— like events, 
measured in water-Cerenkov detectors, performed here overlaps very little with the earlier 
investigations. 



2 3-z/ Oscillations of Atmospheric Neutrinos in the Earth 

In the present Section we summarize the results on the oscillations of atmospheric neu- 
trinos crossing the Earth, which we use in our analysis. 



2.1 Preliminary Remarks 

The z/ M — > u e [p^ — > 9,?) and v e — > u^ T ) [p e — > v^ T j) oscillations of atmospheric neutrinos 
should exist and their effects could be observable if genuine three-flavour-neutrino mixing 
takes place in vacuum, i.e., if sin 2 2#i 3 7^ 0, and if sin 2 2^13 is sufficiently large (20] (see also, 
e -g-> j2H 122 Ell E2] ) • Under the condition (Am^l ^> Am^, which the neutrino mass squared 
differences determined by the existing atmospheric and solar neutrino and KamLAND data 
satisfy, the relevant three- neutrino — > u e [y^ — > u e ) and v e — > v^t) (v e —* ^V(V>) transition 
probabilities reduce effectively to a two- neutrino transition probability jH]. with Am 2 ^ 
and sin 2 2^13 = 4|£/" e 3| 2 (l — |t/ e 3| 2 ) playing the role of the relevant two-neutrino oscillation 
parameters. Thus, searching for the effects of — ► v e {p^ — > u e ) and v e — > v^ [p e — > ^(r)) 
transitions of atmospheric neutrinos, amplified by Earth matter effects, can provide unique 
information, in particular, about the magnitude of sin 2 # 13 . 

As is not difficult to show using the results of jUj, the 3- neutrino oscillation probabilities 
of interest for atmospheric v e ^ having energy E and crossing the Earth along a trajectory 
characterized by a Nadir angle 9 n , have the following form (see also, e.g., [2*2^12*5]): 

PU»e -> U e ) 1 - P 2v , (3) 

P^M -> V„) = P 3 u{^ -> Ve) = 4 P2ui (4) 
P3,^e -> V T ) = 4 P2u, (5) 

PU»n -> ^) = 1 - 4 p 2u ~ 244 [l - Re {e~ iK A 2v (v T -> u r ))] , (6) 
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Here P 2v = P2v(Am 31 , @i3] E, 9 n ) is the probability of two-neutrino oscillations in the Earth 
which coincides in form with, e.g., the two- neutrino v e — + v T transition probability, P 2v (u e ~~ * 
v T ), but describes v e — > v' T transitions, where v' T = s 23 v^ + c 23 u T jUj, and k and A 2v {y T — > 
u T ) = A 2v are known phase and two-neutrino transition probability amplitude. Analytic 
expressions for P 2u , k and A 2v will be given later. 

Using eqs. (jSJ) - © it is not difficult to convince oneself that the fluxes of atmospheric 
v e4i of energy E, which reach the detector after crossing the Earth along a given trajectory 
specified by the value of 9 n , $„ e (E, 9 n ), are given by the following expressions in the case 
of the three- neutrino oscillations under discussion EH |22] : 



$„ e (£,0 n ) = < (l + [s 2 23 r-l]P, 
9 V (E, 9 n ) = d>° (l + 4 [(4, r)- 1 - 1] P 2v - 2c 2 23 s 2 23 \l - Re {e~^A 2v {v T -> v T )) 



(9) 

where $° = $° (E, 9 n ) is the Uetn) flux in the absence of neutrino oscillations and 

®l CM*) 

rs « E ^ s wm ■ (10) 

The interpretation of the SK atmospheric neutrino data in terms of — > v T oscillations 
requires the parameter s\ 3 to lie approximately in the interval (0.30 - 0.70), with 0.5 being 
the statistically preferred value. For the predicted ratio r(E, 9 n ) of the atmospheric 
and v e fluxes for i) the Earth core crossing and ii) only mantle crossing neutrinos, having 
trajectories for which 0.4 < cos# n < 1.0, one has 031101111!: r(E,9 z ) S (2.0 - 2.5) for 
the neutrinos giving contribution to the sub-GeV samples of Super-Kamiokande events, and 
r(E, 9 n ) = (2.6 — 4.5) for those giving the main contribution to the multi-GeV samples. If 

= 0.5 and r(E,9 z ) = 2.0, we have (s| 3 r(E,9 z ) - 1) = and the possible effects of 
the — > u e and u e — > v^t) transitions on the v e and fluxes, and correspondingly on 
the sub-GeV e— like sample of events, would be strongly suppressed even if these transitions 
were maximally enhanced by the Earth matter effects. For the multi-GeV neutrinos we have 
(s 2 23 r(E,9 z ) - 1) > 0.3 (0.9) for s 2 23 = 0.5 (0.7). The factor (s 2 23 r(E,9 z ) - 1), for instance, 
amplifies the effect of the — > v e transitions in the e— like sample for E ^ (5 — 6) GeV, for 
which r(E,9 z ) £4 |351 SUEZ!. 

The same conclusions are valid for the effects of oscillations on the fluxes of, and event 
rates due to, atmospheric antineutrinos: i> e and v^. Actually, the formulae for anti-neutrino 
fluxes and oscillation probabilities are analogous to those for neutrinos: they can be ob- 
tained formally from eqs. © - (fTUjl by replacing the neutrino related quantities - proba- 
bilities, K, A 2v [y T — > u T ) and fluxes, with the corresponding quantities for antineutrinos: 
P 2v {Aml 1 , 0i3 ; E, 9 n ) -> P 2u (Aml 1 , 13 ; E, 9 n ), R, A 2v {v t -> v T ) -> A 2v {v T -> v T ) = A 2u , 

PzM -> W) -> Ptofa -> vi>), $82„(M») -> 41 (Mn) and r(E,9 n ) -> f(E,9 n ). 

Equations and the similar equations for antineutrinos imply that in the 

case under study the effects of the — > u e , — > u e , and v e — > i^( T ), v e — ► ^/j(t)> oscillations 

i) increase with the increase of s 23 and are maximal for the largest allowed value of s 23 , 

ii) should be considerably larger in the multi-GeV samples of events than in the sub-GeV 
samples, iii) in the case of the multi-GeV samples, they lead to an increase of the rate of 
e-like events and to a slight decrease of the /z— like event rate. This discussion suggests that 
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the quantity most sensitive to the effects of the oscillations of interest should be the ratio of 
the \x— like and e— like multi-GeV events (or event rates), N^/N e . 

The magnitude of the effects we are interested in depends also on the 2-neutrino oscillation 
probabilities, P2 U (Aml 1 , #13; E, 6 n ) and i^^Am^, #13; E, 9 n ). In the case of oscillations in 
vacuum we have P 2 y(Am 2 il , #13 ; E, 6 n ) = P 2u (Amf 1 , # 13 ; E, 6 n ) ~ sin 2 26 , 13 . Given the existing 
limits on sin 2 2#i3 , the probabilities P 2v and P 2v cannot be large if the oscillations take place 
in vacuum. However, P 2v or P 2v can be strongly enhanced by the Earth matter effects. The 
latter depend on the Earth density profile and we will discuss it next briefly. 

2.2 The Earth Model and the Two-Layer Density Approximation 

As is well-known, the Earth density distribution in the existing Earth models is assumed 
to be spherically symmetric 2 and there are two major density structures - the core and the 
mantle, and a certain number of substructures (shells or layers). The core radius and the 
depth of the mantle are known with a rather good precision and these data are incorporated 
in the Earth models. According to the Stacey 1977 and the more recent PREM models 
[1HI EH] , which are widely used in the calculations of the probabilities of neutrino oscillations 
in the Earth, the core has a radius R c = 3485.7 km, the Earth mantle depth is approximately 
Rman — 2885.3 km, and the Earth radius is = 6371 km. The mean values of the 
matter densities of the core and of the mantle read, respectively: p c = 11.5 g/cm 3 and 

Pman =4.5 g/cm 3 . 

All the interesting features of the atmospheric neutrino oscillations in the Earth can be 
understood quantitatively in the framework of the two-layer model of the Earth density 
distribution [20]. The density profile of the Earth in the two-layer model is assumed to 
consist of two structures - the mantle and the core, having different densities, p man and p c , 
and different electron fraction numbers, "K e man and Y^, none of which however vary within 
a given structure. The densities p man and p c in the case of interest should be considered 
as mean effective densities along the neutrino trajectories, and they vary somewhat with 
the change of the trajectory [20]: p man = p man and p c = p c . In the PREM and Stacey 
models one has for cos# n ?Z 0.4: p man = (4 — 5) g/cm 3 and p c = (11 — 12) g/cm 3 . For the 
electron fraction numbers in the mantle and in the core 3 one can use the standard values [50J 
yrnan = QAQ and yc = Q 4g7 Numerical calculations show [SI] (see also |2D1I2Z!) that, e.g., 
the v e — > i/fi oscillation probability of interest, calculated within the two-layer model of the 
Earth with p man and p c for a given neutrino trajectory determined using the PREM (or the 
Stacey) model, reproduces with a remarkably high precision the corresponding probability 
calculated by solving numerically the relevant system of evolution equations with the much 
more sophisticated Earth density profile of the PREM (or Stacey) model. 

We give below the expressions for the probability P 2u (E, n ; Am^, 6*i 3 ), for the phase k 
and for the amplitude A 2v [y T — > u T ) in the two-layer approximation of the Earth density 
distribution and in the general case of neutrinos crossing the Earth core. The expression for 
P 2lJ (E, 9 n ; Arajj!, #13), as we have already indicated, coincides with that for the probability 

2 Let us note that because of the approximate spherical symmetry of the Earth, a given neutrino trajectory 
through the Earth is completely specified by its Nadir angle. 

3 The electron fraction number is given by Y e — N e / (N p + N n ) — N P J (N p + N n ), where N e , N p and N n 
are the electron, proton and neutron number densities in matter, respectively. 
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of the two-neutrino v u — > v e [y e — > iv r )) transitions and has the form [20] 4 : 
P 2 „(£, 0,; Amfi, 0i 3 ) = ^ [1 - cos A£"X"] sin 2 20^ 

+ - [1 - cos AE"X"] [1 - cos A£'X'] [sin 2 (2C - 40' m ) - sin 2 2^ 
- ^ [1 - cos AE"X"} [1 - cos 2A£'X'] sin 2 29' m cos 2 (2^ - 
+ - [1 + cosAE"X"] [1 -cos2A£ , X'] sin 2 20^ 
+ ~sinA£"X" sin2A£'X' sin 2 20^ cos^ - 20 J 
+ ~ [cos(A£'X' - A£"X") - cos(A£'X' + AE"X")} sin 40^ sin(2^ - 20J. (11) 



Here 



AE' (AE") = 

v ; 2£ 



2 



\ \ p r r 



Pman(c)\ cog 2 + 2 13 , (12) 



man (c) 

is the difference between the energies of the two energy- eigenstate neutrinos in the mantle 
(core), 9' m and 0^ are the mixing angles in matter in the mantle and in the core, respectively, 

sin 2 29' m (sin 2 29" m ) = g - — 29n , (13) 

mV mJ (l-^^) 2 cos 2 20 13 + sin 2 20 13 V ' 

^rnan(c) 

X' is half of the distance the neutrino travels in the mantle and X" is the length of the path 
of the neutrino in the core, and p r c es are the resonance densities in the mantle and in 
the core, and p ma n and p c are the mean densities along the neutrino trajectory in the mantle 
and in the core For a neutrino trajectory which is specified by a given Nadir angle 8 n we 
have: 



X' = R e cos 9 n - y/R* - R% sin 2 9 n , X" = 2<J R? c - R% sin 2 n , (14) 

where R® = 6371 km is the Earth radius (in the PREM [IHj and Stacey ^H] models) and 
R c = 3485.7 km is the core radius. The neutrinos cross the Earth core on the way to the 
detector for 9 n < 33.17°. 

The resonance densities in the mantle and in the core can be obtained from the expressions 

Am§! cos 26»i3 , 1C , 
" = 2E^G r Y. (15) 

mjv being the nucleon mass, by using the specific values of Y e in the mantle and in the core. 
We have p r ™ an ^ p r c es because Y e c = 0.467 and Y™ an = 0.49 [SO] (see also |32|). Obviously, 

~yc n res ~yman „r 

ere e rn 



jres 
man' 



4 The expression for P^ v (eq. CU) can b e obtained from the expression for the probability P e 2 — Piy^ 
v e ) given in eq. (7) in [23 by formally setting 8 — while keeping 8' m ^ and 0!^ ^ 0. 
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The phase k and the probability amplitude A 2u which appear in eq. for the flux 
of atmospheric in the case of three-flavour neutrino mixing and hierarchy between the 
neutrino mass squared differences and therefore can play important role in the interpretation 
of the, e.g., Super-Kamiokande atmospheric neutrino data, have the following form in the 
two-layer model of the Earth density distribution [2H1 El 122] : 

K - X+V2G F — {X"Y e c Pc+2X'Yr n p ma n)-2AE'X'-AE"X"]-^Xcos26 12 , 

(16) 

A 2 M - u r ) = 1 + (e-^ E ' x ' - l) [l + ( e - iAE " x " - l) cos 2 (C - O] cos 2 6' m (17) 

+ (e~ lAE " X " - l) cos 2 C + \ (e- lAE " X " ~ l) {e- AE ' X ' - l) sin(2^ - 26&) sin 2^ , 

where 5 X = X" + IX'. 

The expressions for P 2u , R and A 2v {v T — > v T ) can be obtained from the corresponding 
expressions for neutrinos by replacing p ma n,c with (-p ma n,c) in eqs. (fT2|) and (JT3J). 



2.3 Oscillations in the Earth Mantle 

In the two-layer model, the oscillations of atmospheric neutrinos crossing only the Earth 
mantle (but not the Earth core), correspond to oscillations in matter with constant density. 
The relevant expressions for P 2u , k and A 2v {y T — > u T ) follow from eqs. (fTTjl. (fTH|) and (fTTj) 
by setting X" = and using X' = R®cos9 n . The expressions for P 2u (P 2u ) and A 2u (A 2u ) 
have the standard well-known form. 

In the case under study #13 plays the role of a two-neutrino vacuum mixing angle in the 
probabilities P 2u and P 2u . Since sin 2 6> 13 < 0.05, we have cos26 , i 3 > 0. Consequently, the 
Earth matter effects can resonantly enhance P 2v for Am^ > and P 2v if Am 2 x < j2Hj. Due 
to the difference of cross sections for neutrinos and antineutrinos, approximately 2/3 of the 
total rate of the /x— like and e— like multi-GeV atmospheric neutrino events in the SK (and 
in any other water-Cerenkov) detector, i.e., ~ 2N fl /Z and ~ 2N e /3, are due to neutrinos 
and u e , respectively, while the remaining ~ 1/3 of the multi-GeV event rates, i.e., ~ 
and ~ N e /3, are produced by antineutrinos and v e . This implies that the Earth matter 
effects in the multi-GeV samples of /i— like and e— like events will be larger if Am^ > 0, i.e., 
if the neutrino mass spectrum is with normal hierarchy, than if Am| x < and the spectrum 
is with inverted hierarchy. Thus, the ratio N^/Nf, of the multi-GeV /i— like and e— like event 
rates measured in the SK experiment is sensitive, in principle, to the type of the neutrino 
mass spectrum. 

Consider for definiteness the case of Am^ > 0. It follows from eqs. (JBJ) and (jHJ) that 
the oscillation effects of interest will be maximal if P 2v = 1. The latter is possible provided 
i) the well-known resonance condition [SSI 01], leading to sin 2 2Q' m = 1, is fulfilled, and ii) 
cos2A_E"X' = —1. Given the values of p ma n and F e mari , the first condition determines the 
neutrino energy at which P 2v can be enhanced: 

E res ^ 6.6 x Am^lO" 3 eV 2 ] (N^Nachi- 3 ])- 1 cos2# 13 GeV, (18) 

5 One can get the expression for the amplitude A2 U (v T — > v T ) from eq. (1) in ref. 20 by formally setting 
9 = 7r/2 while keeping 9' m and 9'^ arbitrary, and then interchanging sin#^ (sinfl^J and oos6' m (cos 9'^). 
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where Am^lO -3 eV 2 ] is the value of Am^ in units of 10" 3 eV 2 and N™ an [N A cm -3 ] is the 
electron number density, N™ an = Y™ an p man /m N , in units of Nachi -3 , Na being the Avogadro 
number. If the first condition is satisfied, the second determines the length of the path of 
the neutrinos in the mantle for which one can have P 2v = 1: 



where X' is in units of 10 4 km. Taking Am§ x = (2.1 - 3.3) x 1(T 3 eV 2 , N™ an = 2 N A cm~ 3 
and cos2# 13 = 1 one finds from eq. (|18|): E res = (7 — 11) GeV. The width of the resonance 
in E, 25E, is determined, as is well-known, by tan2#i3: 5E/E res ~ tan2#i3. For sin 2 #13 ~ 
(0.01 — 0.05), the resonance is relatively wide in the neutrino energy: 5E/E res = (0.27—0.40). 
Equation (JE) implies that for sin 2 13 = 0.05 (0.025) and N™ an = 2 Nachi -3 , one can have 
P 2v = 1 only if 2X' = 8000 (10000) km. 

It follows from the above simple analysis [25] that the Earth matter effects can amplify 
P 2v significantly when the neutrinos cross only the mantle i) for E ~ (5 — 10) GeV, i.e., in 
the multi-GeV range of neutrino energies, and ii) only for sufficiently long neutrino paths in 
the mantle, i.e., for cos9 n ^ 0.4. The magnitude of the matter effects in the ratio N^/N e of 
interest increases with increasing sin 2 # 13 . 

The same results, eqs. (118)1 and p9jl . and conclusions are valid for the antineutrino 
oscillation probability P 2v in the case of Am| x < 0. As a consequence, the ideal situation for 
distinguishing the type of mass hierarchy would be a detector with charge discrimination. 

2.4 Oscillations of Atmospheric Neutrinos Crossing the Earth Core 

In this case P 2u , K and A 2u are given by eqs. (JTTJ), |T6|) and (fPTj) . In the discussion which 
follows we will assume for concretness that Am^ > 0, consider the probability P 2v and the 
transitions of neutrinos. If Am^ < 0, the results we will briefly discuss below will be valid 
for the probability P 2u and the transitions of antineutrinos. 

For sin 2 #13 < 0.05 and Amf^ > 0, we can have P 2v — 1 only due to the effect of maximal 
constructive interference between the amplitudes of the the v e — > v' T transitions in the Earth 
mantle and in the Earth core |2TH I4T)| I4~T] . The effect differs from the MSW one [20] • The 
mantle-core enhancement effect is caused by the existence (for a given neutrino trajectory 
through the Earth core) of points of resonance-like total neutrino conversion, P 2v = 1, in 
the corresponding space of neutrino oscillation parameters [ITU I41j. The location of these 
points determines the regions where P 2v is large, P 2v ^0.5. These regions vary slowly with 
the Nadir angle, they are remarkably wide in the Nadir angle and are rather wide in the 
neutrino energy [41 J, so that the transitions of interest produce noticeable effects in the ratio 
N^/N e : we have, e.g., 5E/E = 0.3 for the values of sin 2 6*13 of interest. 

The resonance-like total neutrino conversion due to the mantle-core enhancement effect 
takes place for a given neutrino trajectory through the Earth core if the following two 
conditions are satisfied [3D| I4T|: 



2X'(AE') 



res — 



1.2?r tan20 13 N™ an [N A cm 



3 ] 2X'[10 4 km] , 



(19) 




tan - AE"X" = ± 



2 




cos 28' 



in 



(20) 
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where the signs are correlated and cos 26*^ cos(26^ — 46^J < 0. As was shown in [JT], 
conditions (J2*U|) are fulfilled for the — *> v e and v e — > z/ M ( r ) transitions of the Earth core- 
crossing atmospheric neutrinos. A rather complete set of values of Am^/E and sin 2 2# 13 for 
which both conditions in (|2T)|) hold and P 2v = 1 for neutrino trajectories with Nadir angle 
6 n = 0; 13°; 23°; 30° was also found in [II]. 

For sin 2 6 Vi < 0.05, there are two sets of values of Am 2 ! and sin 2 # 13 for which eq. (j2"Uj) 
is fulfilled and P 2u = 1. These two solutions of eq. (J2T?)) occur for, e.g., 6 n = 0; 13°; 23°, 
at 1) sin 2 2^13 = 0.034; 0.039; 0.051, Am 2 31 /E = 7.2; 7.0; 6.5 x 10~ 7 eV 2 /MeV, and at 
2) sin 2 2#i3 = 0.15; 0.17; 0.22, AmgjE = 4.8; 4.5; 3.8 x 10~ 7 eV 2 /MeV (see Table 2 in 
ref. jHJ). The first solution corresponds to cos2A£"X' = —1, cosA£"'X" = — 1 and 6 
and sin 2 (2#^ — 46^) = 1. For Am 2 = 3 x 10~ 3 eV 2 , the total neutrino conversion occurs 
in the case of the first solution at E = (4.2 — 4.7) GeV. The atmospheric v e and with 
these energies contribute to the multi-GeV samples of e— like and /x— like events in the SK 
experiment. The values of sin 2 26*i 3 at which the second solution takes place are marginally 
allowed. If Am 2 = 3 x 10~ 3 eV 2 , one has P 2v = 1 for this solution for a given 9 n in the 
interval < n < 23° at E lying in the interval E = (6.3 - 8.0) GeV. 

The above discussion suggests, in particular, that the effects of the mantle-core (NOLR) 
enhancement of P 2v (or P 2v ) in the ratios N^/N e and N^/N® increase rapidly with sin 2 #i 3 
as long as sin 2 6*i 3 ^ 0.01, and should exhibit a rather weak dependence on sin 2 #13 for 
0.01 ^ sin 2 6*i3 < 0.05. If 3-neutrino oscillations of atmospheric neutrinos take place, the 
magnitude of the matter effects in the multi-GeV e— like and \i— like event samples, produced 
by neutrinos crossing the Earth core, should be larger than in the event samples due to 
neutrinos crossing only the Earth mantle (but not the core). This is a consequence of the 
fact that in the energy range of interest the atmospheric neutrino fluxes decrease rather 
rapidly with energy - approximately as E~ 21 , while the neutrino interaction cross section 
rises only linearly with E, and that the maximum of P 2v (or P 2v ) due to the NOLR takes 
place at approximately two times smaller energies than that due to the MSW effect for 
neutrinos crossing only the Earth mantle (e.g., at E = (4.2 — 4.7) GeV and E = 10 GeV, 
respectively, for Am 2 = 3 x 10~ 3 eV 2 ). 

3 Results 

The results of our analysis are summarized graphically in Figs. 1-5. We have used in the 
calculations the predictions for the Nadir angle and energy distributions of the atmospheric 
neutrino fluxes given in [Uj- In this analysis, we only consider Deep Inelastic Scattering 
(DIS) cross sections and we make use of the GRV94 parton distributions given in 

The predicted dependences on cos 9 n of the ratios of the multi-GeV fi— and e— like events 
(or event rates), integrated over the neutrino energy from the interval E = (2.0 — 10.0) GeV, 
in the case i) of two-neutrino — > v T and — + v T oscillations in vacuum and no v e 
and i> e oscillations, N 2u /N®, ii) three-neutrino oscillations in vacuum of u^, v e and 9 e , 
(]Vjj7iVf)«, iii) three-neutrino oscillations of u^, 9^, v e and v e in the Earth in the cases of 
neutrino mass spectrum with normal hierarchy (N^ /N^ u )^n, and with inverted hierarchy, 

6 The term "neutrino oscillation length resonance" (NOLR) was used in [23j to denote the mantle-core 
enhancement effect in this case. 
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Figure 1: The dependence on cos#„ of the ratios of the multi-GeV [i— and e— like events 
(or event rates), integrated over the neutrino energy in the interval E = (2.0 — 10.0) GeV, 
in the cases i) of two-neutrino z/ M — > v T and — > v r oscillations in vacuum and no v e and v e 
oscillations, N^/N® (solid lines), ii) three-neutrino oscillations in vacuum of z/ M , z/ M , v e and 
z/ e , (N^ u /Nl v ) vac (dash-dotted lines), iii) three-neutrino oscillations of z/^, u e and u e in 
the Earth and neutrino mass spectrum with normal hierarchy (N^ u / N^ U ) NH (dashed lines), 
or with inverted hierarchy, (N^ v / N^)m (dotted lines). The results shown are for jAm^l = 
3 x 10~ 3 eV 2 , sin 2 ^23 = 0.36 (upper panels); 0.50 (middle panels); 0.64 (lower panels), and 
sin 2 2^13 = 0.05 (left panels); 0.10(right panels). 
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(N* u /N* v ) m , for sin 2 ^ 2 3 = 0.64; 0.50; 0.36, sin 2 29 13 = 0.05; 0.10 and \Am 2 31 \ = 3xKT 3 eV 2 
are shown in Fig. 1. 

As cos# n increases from to ~ 0.2, the neutrino path length in the Earth increases from 
to 2X' = 2R 9 cos9 n = 2550 km. The — > v T [p^ — > u T ) oscillations, which for cos9 n ^ 0.2 
proceed in the Earth essentially as in vacuum, fully develop. For [Am 2 ^ = 3 x 10 -3 eV 2 
and E = 3 GeV, for example, the maximum of the — > v T {v^ — > v T ) oscillation probability 
occurs for cos0 n = 0.1, or 2X' = 1270 km. For cos0 n < 0.2 and (Am^l = 3 x 10~ 3 eV 2 , the 
oscillations involving the atmospheric v e [y e — > v^ri v ii - > v e) and v e iv e — > v^, — > i/ e ) 
with energies in the multi-GeV range, E ~ (2.0 — 10.0) GeV, are suppressed. If Am^ > 0, 
for instance, the Earth matter effects suppress the antineutrino oscillation probability P 2l/ , 
but can enhance the neutrino mixing in matter, or sin 2 29' m . However, since the neutrino 
path in the Earth mantle is relatively short one has 2X'AE' <C 1, and correspondingly 
P 2v < 1. Thus, for cos0 n < 0.2, all four types of ratios we consider, N 2u /N°, (N^/N^) vac , 
(JV^7^f)NH and (N^ u /N^ u )m, practically coincide and exhibit the same dependence on 
cos9 n : they decrease as cos9 n increases from 0, reaching a minimum at cos9 n = 0.1, and 
begin to rise as cos 9 n increases further. This behavior is clearly seen in Figs. 1 and 2. 
At cos9 n ^ 0.4, the Earth matter effects in the oscillations of the atmospheric u^, 
v e and v e , can generate noticeable differences between N 2l, /N® (or (N^ /N^ u ) vac ) and 
(N 3 7iVf)NH(iH), as well as between (N^/N^) NH and (N^/N^) m . For sin 2 9 23 = 0.36 and 
sin 2 2^13 ^ 0.05 (upper left panel in Fig. 1), we have at cos9 n ^ 0.8 (neutrinos crossing 
only the Earth mantle): {N^/Nf ) NH = (N* u /N* u ) m = N 2u /N° = {N^/Nf ) vac . For the 
Earth-core-crossing atmospheric neutrinos, cos6 ) n ^ 0.84, the mantle-core interference effect 
(or NOLR) suppresses the ratios (A^/A^nh, IH with respect to Nf/N® (or (N*» /N* u ) vac ): 
at sin 2 20i3 = 0.10 the relative averaged difference between N 2u /N® and (A^/A^nh is 7 
11%, while the difference between (A" 31 ' / 7V 3!/ )nh and (iV 3l/ / 'N^ u )m is rather small (upper right 
panel in Fig. 1). 

At sin 2 6*23 Z 0.50, the differences between N 2u /N® and (A^/A^nh, ih become notice- 
able already at cos9 n ^ 0.4. They increase with the increasing of sin 2 #23 and/or sin 2 26?i3, 
and are maximal for sin 2 #23 = 0.64 and sin 2 26\ 3 = 0.10. The dependence on sin 2 #23 is 
particularly strong. The deviations from the vacuum oscillation ratio {N^ /N^) vac increase 
with the increasing of cos#„ ^ 0.4 as well; they are maximal for the Earth-core-crossing 
neutrinos, cos6 ) n ^ 0.84. 

For sin 2 9 23 = 0.50 and sin 2 26>i 3 = 0.05; 0.10, the relative difference between N 2u /N® and 
(N^/N^) NH in the interval cos0 n ^ (0.5-0.84) is approximately 11%; 13%; for sin 2 29 23 = 
0.64 and sin 2 26?i3 = 0.05; 0.10, it is 18%; 24%. The same differences are larger in the Earth 
core interval cos# n = (0.84 — 1.0) due to the mantle-core enhancement (NOLR) [2T) | I4T H I4*T] . 
reaching on average values of 24%; 27% for sin 2 9 23 = 0.50 and sin 2 29 13 = 0.05; 0.10, and 
35%; 38% for sin 2 26^3 = 0.64 and the same two values of sin 2 29 V3 . 

For sin 9 23 = 0.50, and sin 2 29 13 = 0.05; 0.10, the relative difference between N 2v /N® 
and the ratio N^/Ng in the case of IH neutrino mass spectrum, (N^ u /N^)m, in the interval 
cos6 ) n = (0.50 — 0.84) has a mean value of approximately 6%; 8%, while if sin 2 26*23 — 0.64 it 
is approximately 10%; 14%. It is larger in the Earth core bin, cos6 ) n = (0.84 — 1.0), reaching 
approximately 25% for sin 2 26*23 — 0.64 and sin 2 2#i3 = 0.10. 

7 The relative difference of, e.g, N* v /N° and (N^/N^nn is denned as (1 - (N^ /N^) NH /(N^ /N°)). 
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Figure 2: The same as in Fig. 1 but for the ratios of the /x— and e— like events (or event 
rates), integrated respectively over the neutrino energy in the intervals E = (4.0 — 10.0) 
GeV (left panel), and E = (2.0 - 100.0) GeV (right panel), and for \Am 2 31 \ = 3 x 10~ 3 eV 2 , 
sin 2 # 23 = 0.50 and sin 2 2#i 3 = 0.10. 



The magnitude of the difference between N 2u /N® and (A^ iy /A^^) NH (iH) exhibits a rela- 
tively strong dependence on the minimal value of the neutrino energy E from the integration 
interval, E m i n , and a rather mild dependence on the maximal E in the interval, E max . With 
the increase of E m i n , the relative magnitude of the contributions to the energy-integrated 
event rates of interest, coming from the energy interval in which the matter effects are sig- 
nificant, also increases, leading to larger difference between Nj^/N® and (iV^/iVg l/ ) N H(iH)- 
This is illustrated in Fig. 2, where the ratios of interest are shown as functions of cos# n for 
| Am 2 ! | = 3 x 10" 3 eV 2 , sin 2 # 23 = 0.50, sin 2 13 = 0.10, and i) E min = 4 GeV, E max = 10 
GeV (left panel), and ii) E m i n = 2 GeV, E max = 100 GeV (right panel). Increasing E m i n 
(E max ) while keeping E max (E min ) intact would lead to the decreasing (increasing) of the 
statistics in the samples of /x— like and e— like events of interest. 

As Fig. 2 illustrates, the relative differences between i) Nff/N^ and (N^ U /N^) NH and 
ii) Nff/N^ and (N^/N^) m , increase noticeably in the interval cos6> n = (0.40 - 0.65) with 
the increase of E m i n , being almost constant for E m i n = 4 GeV and reaching the values of 
approximately 29% and 19%, respectively 8 . For cos^n = (0.84— 1.0), the differences under 
discussion exhibit a characteristic oscillatory pattern. These differences have a completely 
different behavior as functions of cos# n if E max is increased to 100 GeV, keeping E min = 2 
GeV (Fig. 2, right panel): they increase approximately linearly with cos# n , starting from 
at cos0„ ^ 0.25, and having at cos# n 2* 0.70; 0.84 the values i) 17%; 21% and ii) 9%; 13%, 
respectively. 

In Fig. 3 we show the predictions for the different ratios of /x— like and e— like event rates 
we consider, integrated over the neutrino energy in the interval E — (2—10) GeV and over 
cos 6 n in the interval cos 6 n = (0.4-1.0), i) as functions of sin 2 26 13 for (Am^l = 3xl0" 3 eV 2 

8 The relative difference between (N^/N^) m and {N^/N^) NH is - 12%. 
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Figure 3: The four different ratios of the multi-GeV //— and e— like events (or event 
rates), integrated over the neutrino energy in the interval E = (2.0 — 10.0) GeV and 
over the Nadir angle in the interval corresponding to 0.40 < cos6 n < 1.0, as func- 
tions i) of sin 2 2# 13 for (Am^l = 3 x 10~ 3 eV 2 (left panels), and ii) of (Am 2 -,] for 
sin 2 2# 13 = 0.10 (right panels): N^/N° (solid lines), (N^/N^) vac (dash-dotted lines), 
(N^/N^) NH (dashed lines) and (N^/N^) m (dotted lines). The results shown are obtained 
for sin 2 ^23 = 0.36 (upper panels); 0.50 (middle panels); 0.64 (lower panels). 
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Figure 4: The ratio N^ u /N° of e— like multi-GeV events (or event rates), for v e and v e 
taking part in 3- neutrino oscillations in the Earth {N^ u ), and v e and v e not taking part in 
the oscillations (N°), as a function of cos 6 n for sin 2 2^13 = 0.10 (solid lines); 0.05 (dashed 
lines), and for neutrino mass spectrum with normal hierarchy (upper solid or dashed lines) 
and with inverted hierarchy (lower solid or dashed lines). The results shown are for sin 2 # 23 = 
0.5 (left panel); 0.64 (right panel), and for |Am|J = 3 x 10~ 3 eV 2 . See text for details. 

(left panels), and ii) as functions of (Am^l for sin 2 26>i 3 = 0.10 (right panel). In each case 
the results presented are for three values of sin 2 #23 = 0.36; 0.50; 0.64. The differences 
between the ratios of the integrated fi— like and e— like event rates of interest, i.e., i) between 
N l v l N e and ( N ^ u / N e U )NH and ii) between Nf/N^ and (N^/N^ u ) m , increase rather rapidly 
as sin 2 20 13 increases from to sin 2 26> 13 = 0.05, while the increase is slower in the interval 
sin 2 2^i 3 = (0.05 - 0.10). At sin 2 29 13 = 0.05, the relative differences between Nj^/N® and 
i) (A^ !y /iVg !/ )NH and ii) (Nj^ /N^ u )m in the case under discussion are respectively 13% and 
8% for sin 2 #23 = 0.50; for sin 2 #23 = 0.64 they are considerably larger, 21% and 13%. If 
sin 2 2# 13 = 0.10, the same two differences for sin 2 6 23 = 0.50 ; 0.64 read 17%; 28% and 
10%; 17%, respectively. 

It follows from Fig. 3, right panel, that differences between the integrated ratios /N® 
(or (A^/iVf ) mc ) and (N^/N^) NH , and (A^/iVf ) ffl and (N^/N^) NH , are maximal for 
values of |Am 31 | lying in the interval (2 — 3) x 10~ 3 eV 2 , which are favored by the current 
atmospheric neutrino data. 

In Figs. 4 and 5 we present results just for the multi-GeV e-like event rate. The Earth 
matter effects are largest in the oscillations of the atmospheric v e or v e . The dependence of 
the ratio N^ v /N^ , N^ u and N® being the numbers of multi-GeV e-like events (or event rates) 
predicted in the cases of 3-v oscillations of v e , 9 e , and of absence of oscillations (sin 2 6> 13 = 0), 
on cos#„ is shown in Fig. 4 for sin 2 6* 23 = 0.50 ; 0.64 and for sin 2 # 13 = 0.05; 0.10. The 
deviation of N^ v /N® from 1 would signal that v e and v e take part in oscillations and that 
sin 2 #13 7^ 0. We can have N^/N® > 1 only if a substantial fraction of the atmospheric 

(or P M ) oscillate into v e (p e ). As Fig. 4 shows, the ratio N^/N® increases with the 
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Figure 5: The dependence of the ratio N^ u /N° i) on sin 2 # 13 for |Am^| = 3 x 10~ 3 eV 2 
(left panels), and ii) on (Am 2 ^ for sin 2 9 13 = 0.10 (right panels), in the cases of neutrino 
mass spectrum with normal hierarchy (solid lines) and inverted hierarchy (dashed lines). In 
this figure N^ u and N° are the multi-GeV e-like events (or event rates) for v e and v e taking 
part in 3-neutrino oscillations in the Earth and v e and v e not taking part in the oscillations, 
respectively, integrated over the Nadir angle 6 n in the intervals corresponding to a) 0.84 < 
cos9 n < 1.0 - neutrinos crossing the Earth core (upper panels), and b) 0.40 < cos# n < 1.0 
(lower panels). The results shown are for sin 2 #23 = 0.36 (lower doubly thick solid or dashed 
lines); 0.50 (middle thin solid or dashed lines); 0.64 (upper doubly thick solid or dashed 
lines) . 

increasing of cos# n and can be significantly greater than 1 for cos#„ ^ 0.4. At cos#„ = 0.8, 
for instance, we have for sin 2 #23 = 0.50 and sin 2 26\ 3 = 0.05; 0.10 in the case of NH neutrino 
mass spectrum (N^/N°) NH = 1.14; 1.19, while for sin 2 6 23 = 0.64 one finds (N* V /N°) NH = 
1.21; 1.29. For IH neutrino mass spectrum the ratio of interest, (N^ /N®) IH , is smaller and 
the corresponding values read: (N^/N°) IH ^ 1.07; 1.10 and (N* U /N°) IH ^ 1.11; 1.15, 
respectively. For the Earth-core-crossing neutrinos both (N^ /N®)nh and (N^ /N®)ih are 
larger due to the NOLR effect, and for sin 2 # 23 = 0.64 and sin 2 9i 3 = 0.10 reach the values 
{Nl v /N° e ) NH = 1.45 and {N^/N° e ) IH = 1.26. 

For given sin 2 # 23 and and sin 2 #13, the maximum of the ratio of the multi-GeV e-like 
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event rates of interest N% v and N®, integrated over 9 n in the intervals corresponding to a) 
cos# n = (0.84 — 1.0) (Earth core bin) and b) cos# n = (0.40 — 1.0), occurs again for values 
of lAmg-J = (2 — 3) x 10~ 3 eV 2 (Fig. 5, right panels), favored by the existing atmospheric 
neutrino data. For lAmfJ = 3 x 10~ 3 eV 2 , sin 2 6 13 = (0.05 - 0.10) and sin 2 6 23 = 0.64, the 
two types of 9 n — integrated ratios can be as large as: case a) (N^/N°) N h<ih) — 1-36 — 
1.39 (1.20 - 1.23), and case b) (N^ /N°) NH (ih) = 1.19 - 1.26 (1.11 - 1.15) (Fig. 5, left and 
right panels). 

4 Conclusions 

In the present article we have studied the possibility to obtain evidences for Earth matter 
enhanced 3-neutrino oscillations of the atmospheric neutrinos involving, in particular, the u e 
(or u e ), from the analysis of the /i— like and e— like multi-GeV event data accumulated by the 
SK experiment, or that can be provided by future water-Cerenkov detectors. Such evidences 
would give also important quantitative information on the values of sin 2 #13 and sin 2 #23 and 
on the sign of Am\ = Am^. We have considered 3-neutrino oscillations of the atmospheric 
z/^j, u^, v e and u e , assuming that the inequality Am|, = Am^ <C |Ara^J = |Am 31 | holds, as 
is suggested by the current solar and atmospheric neutrino data. Depending on the sign of 
Am 2 1; the Earth matter effects in this case can enhance either the — > u e and v e — > u^, or 
the — > v e and — > transitions if sin 2 #13 7^ 0. The effects of the enhancement can be 
substantial for sin 013 Z 0.01 and sin 2 6 23 Z 0.50. They are largest in the multi-GeV e-like 
and fi— like samples of events and for atmospheric neutrinos with relatively large path length 
in the Earth, crossing deeply the mantle or the mantle and the core, i.e., for cos# n Z 0.4, 
where 9 n is the Nadir angle characterizing the neutrino trajectory in the Earth. 

As observables which are particularly sensitive to the Earth matter effects, and thus 
to the values of sin 2 6\ 3 and sin 2 #23, and to the sign of Am| 1; we have considered the 
Nadir-angle distributions of the ratios N^/N^ and N^/N®, where N^ u and are the 
multi-GeV /z— like and e-like numbers of events (or event rates) in the case of 3-v oscillations 
of the atmospheric u e , v e and z/ M , and N® is the number of e— like events in the case of 
absence of oscillations (sin 2 #13 = 0). As is well-known, the ratio of the energy and Nadir 
angle integrated /i— like and e— like events, N ll /N e , has been measured with a relatively high 
precision by the SK experiment [3]. 

We have obtained predictions for the Nadir-angle distributions of N^ u /N^ u and of N^ u /N® 
both for neutrino mass spectra with normal (Am 2 x > 0) and inverted (Am^ < 0) hierarchy, 
{Nf/N? ) NH , (N?/N?) m , (N^/N° e ) NH and (N?/N°) m , and for sin 2 6 23 = 0.64; 0.50; 0.36. 
We compared the latter with the predicted Nadir-angle distributions i) of the ratio N^/Ng for 
the case the 3-neutrino oscillations taking place in vacuum, (N^ u /N^ u ) VSuC , and ii) of the ratio 
Nj^/N®, the predicted number of /i— like and e— like events in the case of 2-neutrino — > v T 
and Vfj, — > v T oscillations of the atmospheric and z/ M , and v e and v e not taking part in the 
oscillations (sin 2 13 = 0). The dependence of the Nadir angle distributions of (N^ u / N^) N k, 
(^7^e")iHi {Np U /N^ u ) vac and N? u /N® on the minimal and maximal neutrino energies in 
the energy integration interval has also been studied. Predictions for these four different 
types of ratios of the suitably integrated over 6 n Nadir angle distributions of the /1— like and 
e— like multi-GeV events were also derived. 
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Our results are presented graphically in Figs. 1-5. We find that for sin 2 # 2 3 = 0.50 and 
sin 2 2#i3 = 0.05, the relative difference between N^ u /N° and (N^ v / N^ U ) NH in the interval 
cos8 n ^ (0.5 - 0.84) is approximately 11%. If sin 2 26 23 = 0.64 and sin 2 26 13 = 0.10, the 
same difference is approximately 24% (Fig. 1). The relative difference between N^ u /AT? and 
(iV^/AffjNH is larger in the Earth core interval cos 8 n = (0.84 — 1.0) due to the mantle-core 
enhancement (NOLR) [201111312], reaching on average values of 24% for sin 2 823 = 0.50 and 
sin 2 28 l3 = 0.05, and of 38% for sin 2 28 23 = 0.64 and sin 2 28 13 = 0.10 (Fig. 1). 

In the case of neutrino mass spectrum with inverted hierarchy, the relative difference 
between Nff/N® and {N^ u /N^) m in the interval cos6» n = (0.50 - 0.84) has a mean value of 
approximately 14%, for sin 2 #23 = 0.64 and sin 2 2# 13 = 0.10. It reaches approximately 25% 
in the Earth core bin, cos 8 n ^ (0.84 - 1.0), for these values of sin 2 2fl 2 3 and sin 2 28 13 (Fig. 
1). 

The magnitude of the difference between N^ u /jV° and (A^/iV 3l/ )NH(iH) exhibits a rela- 
tively strong dependence on the minimal value of the neutrino energy E from the integration 
interval, E min , and a rather mild dependence on the maximal E in the integration interval, 
Emax (Fig. 2). Increasing E min from 2 GeV to 4 GeV and keeping E max = 10 GeV, leads for 
lAmU = 3 x 10~ 3 eV 2 , sin 2 8 23 = 0.50 and sin 2 8 13 = 0.10 to a considerably larger relative 
difference between N^/N° and (^/^) NH(IH) in the interval cos# n = (0.40-0.65), which 
reaches approximately 29% (19%) (Fig. 2). This difference is larger also in the Earth core 
bin, cos8 n = (0.84 — 1.0). We have also found that the differences between the Nadir angle 
and energy integrated ratios N* u /N° (or (N^/N^) vac ) and (N^/N* U ) NH , and (A^/iVf ) ffl 
and (N^ u /N^ u )^n, are maximal for values of jAm 2 ^ lying in the interval (2 — 3) x 10~ 3 eV 2 , 
which are favored by the current atmospheric neutrino data (Fig. 3). The same conclusion 
is valid for the integrated ratio of e— like events N^ v /N® (Fig. 5). 

We have also shown that in the case of the 3-neutrino oscillations of the atmospheric 
neutrinos considered, the ratio N^/N® increases with the increasing of cos8 n and can be 
significantly greater than 1 for cos8 n ^ 0.4. At cos^ = 0.8, for instance, we have for 
sin 2 #23 = 0.50 and sin 2 28 13 = 0.10 in the case of NH neutrino mass spectrum (N^/N®) nh = 
1.19, while for sin 2 8 23 = 0.64 one finds (N* U /N®) NH = 1-29 (Fig. 4). For IH neutrino mass 
spectrum the ratio of interest, (N* U /N°) IH} is smaller: (N^/N°) IH = 1.10 and 1.15. For the 
Earth-core-crossing neutrinos both (N^ u /N®)nh an d (N^ v /N®)ih are enhanced due to the 
NOLR effect, and for sin 2 8 23 = 0.64 and sin 2 8 13 = 0.10 reach the values (N^ U /N^) NH = 1.45 
and (iVf/A^V = 1-26 (Fig. 4). 

It follows from our results that the Earth matter effects in the Nadir angle distribution of 
the ratio of the multi-GeV /x— like and e— like atmospheric neutrino events (or event rates), 
measured in the Super-Kamiokande (or any future water- Cerenkov) experiment, might be 
observable if the atmospheric neutrinos, including the v e and v e , take part in 3-neutrino 
oscillations and sin 2 8\ 3 and sin 2 #23 are sufficiently large. The observation of relatively large 
Earth matter effects (20% - 30%) at cos^ ^ 0.4 would clearly indicate that sin 2 # 13 ^ 0.01, 
sin 2 6*23 ^ 0.50, and would suggest that the neutrino mass spectrum is with normal hierarchy, 
Am^ > 0. However, distinguishing statistically between the neutrino mass spectrum with 
normal and inverted hierarchy requires a high precision measurement of the Nadir angle 
distribution of the multi-GeV ratio N^/N e and is a rather challenging task. 
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